Papers with visual-linguistic model
FeelingBlue: A Corpus for Understanding the Emotional Connotation of Color in Context (2023.tacl-1)
Copied to clipboard
| Challenge: | Experimental results shed light on the emotional connotation of color in context . color is a powerful tool for conveying emotion across cultures . |
| Approach: | They propose a multimodal dataset for exploring the emotional connotation of color as mediated by line, stroke, texture, shape, and language. |
| Outcome: | The proposed model sheds light on the emotional connotation of color in context and the potential for future studies. |
RIVA: A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER (2020.coling-main)
Copied to clipboard
| Challenge: | Named entity recognition (MNER) for tweets is a key task of many applications. |
| Approach: | They propose a pre-trained multimodal named entity recognition model based on Relationship Inference and Visual Attention (RIVA) for tweets. |
| Outcome: | The proposed model improves on the multimodal named entity recognition (MNER) task on tweets with the aid of visual clues. |